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LAYER EDITING METHOD AND APPARATUS 
IN A PEN COMPUTING SYSTEM 



5 PRIORITY 

This application claims priority to an application entitled "Layer Editing Method 
and Apparatus in a Pen Computing System" filed with the Korean Intellectual Property 
Office on October 17, 2002 and assigned Serial No. 2002-63581, the contents of which 
are hereby incorporated by reference. 

10 

BACKGROUND OF THE INVENTION 



1. Field of the Invention 

The present invention relates to a layer editing method and apparatus in a pen 
1 5 computing system. 

2. Description of the Related Art 

Computers, PDAs, mobile terminals, and similar devices are generally 
configured to enable a user to input text, data, or computer commands using a physical 

20 keypad. Recently, touch screen panels (TSP) have been adopted for use with such 
devices, in order to provide an alternative method of inputting information. When 
compared to information input by a keypad, information input by a touch screen panel is 
convenient and greatly enhances the user's experience. In addition, touch screen panels 
may be used to efficiently input information into small information processing terminals 

25 such as PDAs and mobile terminals where a key input device is not practical. 



Conventional input devices having a touch screen panel detect a trail left on the 
touch screen panel by a writing instrument such as a stylus. The device recognizes a 
character or a symbol corresponding to the trail and converts the recognized character or 
30 symbol into a predetermined computer code 
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A method of editing text by writing is described in U.S. Patent No. 5,297,216 
issued to Sklarew. According to this patent, when an insert symbol is written on a screen 
displaying original text, a popup window for insertion is created so that the user can write 
characters or symbols in the window. 

5 

According to U.S. Patent No. 5,297,216, if the user writes an editing symbol on 
a screen displaying original text, an editing apparatus recognizes the symbol and pops-up 
a separate window for insertion over the original text. The user can then write additional 
characters and symbols in that window. The editing apparatus recognizes the handwritten 
10 characters or symbols and then translates them into font symbols. The editing apparatus 
allows the user to confirm the font symbols. Upon confirmation by the user, the editing 
apparatus inserts the font symbols into the original text. U.S. Patent No. 5,666,139, issued 
to Thielens, provides for a popup window for editing text, wherein the pop-up window 
takes the form of a writing pad. 

15 

In the prior art editing apparatus described above, it is time consuming to request 
and display a popup window for editing text. Also, it is inconvenient for a user to write 
characters or symbols within the limited area of the pop-up window. It is a further 
disadvantage that the editing apparatus fails to recognize characters or symbols entered 
20 outside of the window. In addition, the conventional editing apparatus, as described 
above, only stores text in a final edited form. Thus, where text was edited several times, 
a user cannot confirm which changes were made to the text at each editing step. 

SUMMARY OF THE INVENTION 

25 

Accordingly, the present invention has been made to solve the above-mentioned 
problems occurring in editing apparatus as per the prior art. An object of the present 
invention is to provide a layer editing method and apparatus in a pen computing system, 
which can display handwritten changes over original text. 
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Another object of the present invention is to provide a layer editing method and 
apparatus in a pen computing system, which can edit original text by translating 
characters or symbols written by a user into a form that may be processed by a computer. 

5 Yet another object of the present invention is to provide a layer editing method 

and apparatus wherein a user can view and confirm changes that have been made to a text 
at any given editing step. 

In order to accomplish the above objects, there is provided an apparatus for 
10 executing an editing command in a pen computing system, which comprises: a display 
screen for displaying original text to be edited; a layer generating means for generating a 
transparent layer having a layer identifier in response to a layer editing command; a 
memory for storing a trail written on said display screen, together with corresponding 
positional information; and a control section for displaying the generated transparent 
1 5 layer over the original text, sensing a pen input, outputting a trail of the sensed pen input, 
and storing the trail and the positional information in said memory. 

An editing apparatus according to the present invention comprises a transparent 
input screen (i.e., a transparent touch screen) placed over a display screen, and a related 
20 electronic device and a pen for inputting data. 

As the user writes alphanumeric or other characters or symbols on the 
transparent input screen, the characters or symbols are represented by a trail of points 
emulating an input written with a pen on a paper. Once discrete characters or symbols 
25 are completed, they are translated into computer code or computer commands that can be 
displayed on the display screen. The editing apparatus of the present invention analyzes 
handwritten symbols, and translates them into computer-processible recognition data, 
such as font symbols, editing symbols, special characters, or lexigrams. Respective 
recognition data can be stored separately. 

30 
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For the purpose of maintaining consistency throughout this disclosure, the area 
on the surface of the transparent input screen will be referred to as the ''transparent layer." 
The user can edit original text displayed on the display screen by writing characters or 
editing symbols on the transparent layer, which is located directly on the display screen. 
The user can edit the original text displayed on the display screen by writing characters or 
symbols on the transparent layer to overlap the original text, in a similar manner to the 
manual editing of paper printing using transparent paper. The handwritten characters or 
symbols may be displayed in a different color or font for the purpose of distinguishing 
them from the original text. Preferably, the transparent layer has the same text format as 
the original text. 

The editing apparatus according to the present invention senses an input by the 
user with a pen on a transparent layer, i.e. pen movement on the transparent, displays the 
trail of the input on the display screen, and stores the trail information and corresponding 
positional information on the transparent input screen as a single layer of data. 

As used herein, a "handwritten symbol" is a symbol written by the user on a 
transparent layer. An "editing symbol" is a symbol, which is intended, when recognized, 
to cause the computer to execute a particular editing function, such as insert text, delete 
text, delete a letter, or move a margin. An editing symbol, if recognized by the editing 
apparatus, is translated into a corresponding command in order to perform an editing 
function. A "font symbol" is a computer-generated symbol, which represents a 
handwritten symbol in a predetermined font format. 

Changes made to original text can be stored exactly as the user wrote them with 
a pen-like stylus on the transparent layer. Alternatively, the editing apparatus can 
recognize handwritten symbols (including editing symbols) and store text in edited form, 
i.e., text generated by the editing apparatus. In the former case, trail information left by 
handwriting is stored together with corresponding positional information. In the latter 
case, the handwritten symbols, when recognized, are translated into computer-processible 
recognition data such as editing symbols or font symbols, so that only editing information 
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is stored. The editing information can be stored to correspond to a transparent layer. In 
other words, the editing apparatus according to the present invention stores trail 
information written on a transparent layer by the user together with corresponding 
positional information. The editing apparatus, when recognizing editing symbols written 
by the user on original text, assigns an index (a footnote number) to each editing symbol 
at each corresponding position on the original text, and displays the change 
corresponding to each index on the original text. If changes were made to the original 
text several times, the editing apparatus can provide the user with separate information 
about each change made. 

The editing apparatus of the present invention also provides for the correction of 
errors resulting from the incorrect translation of user inputted symbols. For example, the 
editing apparatus can display the written symbols and the recognized codes on the display 
screen, so that the user may compare them. If the user decides that the recognized codes 
are incorrect, the editing apparatus can provide a separate window on the display screen 
for another input by the user. 

Also, if several changes are made to original text, one transparent layer for each 
change is generated. Transparent layers have respective layer identifiers and can be 
stored separately from one another. Each edit of text is indexed and stored separately 
according to its layer identifier. In other words, a transparent layer, if generated, is stored 
separately with an identifier. In addition, each part of the text edited on each transparent 
layer can be stored separately. Image information stored according to a layer identifier 
and recognition data are compressed by a predetermined compression algorithm and 
stored in the memory. 

A plurality of transparent layers can be displayed sequentially and 
simultaneously over the original text displayed on the display screen. The editing 
apparatus will display the original text on the display screen and lay transparent layers 
stored by the user sequentially over the original text. To be specific, the editing apparatus 
will display the original text as an image on the display screen and will display over the 
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image any change inputted on any transparent layer, such as trail information written by 
the user over the image so as to be overlapped with each other. As mentioned above, trail 
information can be displayed in a different color. 

5 In addition, the editing apparatus may display a second transparent layer over a 

first transparent layer and the original text. In this manner, the editing apparatus of the 
present invention can display a plurality of transparent layers over the original text. 

BRIEF DESCRIPTION OF THE DRAWINGS 

10 

The above and other objects, features and advantages of the present invention 
will be more apparent from the following detailed description taken in conjunction with 
the accompanying drawings, in which: 

FIG. 1 is a block diagram showing the construction of an editing apparatus 
1 5 according to a first embodiment of the present invention; 

FIG. 2 is a flow chart showing the processing of a layer editing mode according 
to the first embodiment of the present invention; 

FIG. 3 is a block diagram showing the construction of an editing apparatus 
according to a second embodiment of the present invention; 
20 FIG. 4 is a flow chart showing the processing of a layer editing mode according 

to the second embodiment of the present invention; 

FIG. 5 is a flow chart showing the processing of a layer editing command 
according to the first embodiment of the present invention; 

FIGs. 6a and 6b show a layer editing picture according to the embodiments of 
25 the present invention; and 

FIG. 7 shows the structure of a memory storing layers according to the 
embodiments of the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Hereinafter, preferred embodiments of the present invention will be described in 
detail with reference to the accompanying drawings. In the following description of the 
5 present invention, a detailed description of known functions and configurations will be 
omitted when it may make the subject matter of the present invention unclear. 

FIG. 1 shows the construction of an editing apparatus according to a first 
embodiment of the present invention. Referring to FIG. 1 , an editing apparatus according 

10 to the present invention comprises a display screen 110, a layer generating section 120, a 
memory 130, an off-line recognition processor 140 and a control section 150. The 
display screen 110 displays various images or text under the control of the control section 
150. When an editing command is executed according to the present invention, original 
text to be edited is displayed on the display screen. Also, the display screen 110 can 

15 display a plurality of layers over the original text, under the control of the control section. 

The layer generating section 120 forms a transparent layer on a transparent input 
screen placed directly over the display screen, in order for a user to edit original text. 
The user can edit original text by writing on the transparent layer. As described above, 
20 any change inputted on the transparent layer can be stored exactly as the user wrote it 
with a pen-like stylus on the transparent layer. Trail information written on the 
transparent layer is stored in the memory 130, together with its corresponding positional 
information. The layer generating section 120 can be a transparent input screen, i.e., a 
transparent touch screen, disposed on the display screen. 

25 

The memory 130 stores data concerning transparent layers. Transparent layers 
are identified, indexed, and stored using a layer identifier. Each transparent layer has an 
index and can be selectively accessed by the user. The memory 130 stores any change to 
original text having been made on a transparent layer exactly as the change was written 
30 on the transparent layer by the user with the pen-like stylus. The memory 130 stores trail 
information written by the user on a transparent layer, together with corresponding 
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positional information on the original text. The positional information includes trail 
information stored as an image as well as the position of the trail on the transparent layer, 
i.e., the starting coordinate of the trail. 

If the user writes a character or a symbol with a stylus on a transparent layer, a 
plurality of locating signals representative of a plurality of corresponding positional 
coordinates will be provided to the control section 150. The control section 150 
recognizes a stream of locating signals and stores these signals in the memory 130. Also, 
the control section 150 provides a plurality of corresponding display signals to the 
display screen 1 10. The control section 150 stores in the memory 130 any change to the 
original text having been made on a transparent layer as an image, exactly as it was 
written by the user on the transparent layer. If changes were made to the original text 
several times, the control section 150 individually identify each of the plurality of layers, 
corresponding to a change, and stores the layers in the memory 130. At this time, the 
control section 150 assigns a layer identifier to each transparent layer. 

Also, the control section 150 assigns a footnote number to each change made to 
original text by the user at the corresponding position of the original text, and displays the 
change corresponding to each footnote number over the original text. If changes were 
made to the original text several times, the editing apparatus can provide the user with 
information about the time when each change was made. 

If a command is executed by the user for displaying a plurality of layers over the 
original text, the control section 150 will sequentially display transparent layers having 
corresponding layer information over the original text according to their layer identifiers, 
thereby forming multiple simultaneous layers over the original text. 

Referring again to FIG. 1, the editing apparatus of the present invention may 
include an off-line recognition processor 140 which can analyze symbols written by the 
user and translate them into computer-processible recognition data, such as font symbols, 
editing symbols, special characters, or lexigrams. The off-line recognition processor 140 
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receives any change made by the user as an image from the memory 130, translates the 
image into computer-processible data, and provides the data to the control section 150. 
The off-line recognition processor 140 can be provided independently from the editing 
apparatus of the present invention. 

5 

If the user writes a character or a symbol with a stylus, such as a pen, on a 
transparent layer, the control section 150 will receive a plurality of locating signals 
representative of a plurality of corresponding positional coordinates. The control section 
150 stores these signals in the memory 130 and provides them to the off-line recognition 
10 processor 140. The off-line recognition processor 140 recognizes written symbols and 
translates them into computer text, including font symbols. Alternatively, the off-line 
recognition processor 140 recognizes editing symbols and translates them into 
corresponding computer commands. 

15 When the off-line recognition processor 140 recognizes written symbols and 

translates them into computer-processible recognition data, such as font symbols, editing 
symbols, special characters or lexigrams, the control section 150 allows the user to check 
the recognized codes and correct any error in the codes. For example, the control section 
150 can list and display the written symbols and the recognized codes from the off-line 

20 recognition processor 140 on the display screen. If the user determines that the 
recognized codes are incorrect, the control section 150 can provide a separate window on 
the display screen for another input by the user. 

If a command is executed by the user to incorporate a change to original text, the 
25 control section 150 will receive computer-processible recognition data from the off-line 
recognition processor 140 and will apply editing information selected by the user to the 
original text in order to provide edited text. If changes were made to the original text 
several times, the control section 150 will store editing information corresponding to each 
change separately in the memory 130. 
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FIG. 2 is a flow chart showing the processing of a layer editing mode according 
to the first embodiment of the present invention. Referring to FIGs. 1 and 2, the control 
section 150 of the editing apparatus displays original text on the display screen 110 at 
step 210. At step 212, the control section 150 determines whether the user demands a 
5 layer editing mode to edit the original text. Although not shown in FIG. 2, one 
embodiment allows the user to select a layer editing mode using a predetermined input 
means (for example, soft keys on a touch screen or keys on a keypad). In an alternate 
embodiment, if the user writes an editing symbol with a stylus on the transparent input 
screen, the control section 150 will recognize that the user has edited a layer. In a layer 
10 editing mode, the control section 150 commands the layer generating section 120 to 
generate and display a transparent layer at step 214. Accordingly, the layer generating 
section 120 forms a transparent layer on the transparent input screen placed over the 
display screen. 

15 As described above, the layer generating section 120 can be a transparent touch 

screen disposed on the display screen. Subsequently, the control section 150 detects 
whether the user has initiated a pen input on a transparent layer. If the user enters into a 
layer editing mode by writing with the stylus directly on the transparent input screen, the 
detecting step can be omitted. If the user edits the original text by writing with the stylus 

20 on a transparent layer, the control section 150 will receive a plurality of locating signals 
representative of a plurality of corresponding positional coordinates from the layer 
generating section 120. At step 218, the control section 150 recognizes a stream of 
locating signals and stores these signals in the memory 130. Also, the control section 150 
provides a plurality of corresponding display signals to the display screen 1 1 0 so that a 

25 pen trail can be displayed on the layer. 

At step 220, the control section 150 determines whether stylus input has been 
completed. If no stylus input is made after a predetermined period of time, the control 
section 150 will decide that the input has been completed. Alternatively, if the user 
30 inputs an editing mode termination symbol, the control section 150 will decide that a pen 
input has been completed. At step 222, the control section 150 stores trail information 
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generated by a pen input in the memory 130, together with corresponding positional 
information on the display screen. More specifically, any change made on a transparent 
layer can be stored exactly as written by the user with the stylus on the transparent layer. 
At this time, trail information written on the transparent layer is stored in the memory 130, 
5 together with corresponding positional information from the display screen. The control 
section 150 assigns an index to each editing symbol written by the user over the original 
text, and stores changes made to the original text according to their indexes. The control 
section 150 assigns a footnote number to each editing symbol at a corresponding position 
on the original text, and displays the change corresponding to each footnote number on 
10 the original text. 

At step 224, the control section 150 determines whether it is commanded by the 
user to store a layer. If a layer storage is commanded, the control section 150 will assign 
a layer identifier to the corresponding layer and will store the layer in the memory 130. 

15 

As described above, the control section 150 in this embodiment of the invention 
can be connected to the off-line recognition processor 140, which is separate from the 
editing apparatus. The off-line recognition processor 140 recognizes written symbols and 
translates them into computer text, including font symbols. Alternatively, the off-line 
20 recognition processor 140 recognizes editing symbols and translates them into 
corresponding computer commands. The control section 150 receives computer- 
processible recognition data from the off-line recognition processor 140 and applies 
editing information selected by the user to original text in order to provide edited text. 

25 FIG. 3 shows the construction of an editing apparatus according to a second 

embodiment of the present invention. Referring to FIG. 3, an editing apparatus according 
to the second embodiment of the present invention comprises a display screen 410, a 
layer generating section 420, an on-line recognition processor 430, a memory 440 and a 
control section 450. This editing apparatus is similar in construction to the editing 

30 apparatus illustrated in FIG. 1, except for the on-line recognition processor 430. 
Accordingly, the on-line recognition processor 430 will be explained in detail. 
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In the second embodiment, the editing apparatus comprises the on-line 
recognition processor 430 which analyzes symbols written by the user and translates 
them into computer-processible recognition data, such as font symbols, editing symbols, 
special characters, or lexigrams. 

5 

If the user enters a change to original text by writing with a stylus on a 
transparent layer, the control section 450 will receive a plurality of locating signals 
representative of a plurality of corresponding positional coordinates and will provide the 
signals to the on-line recognition processor 430 in real-time. The on-line recognition 
10 processor 430 recognizes written symbols in real-time as the user writes them, and 
translates the written symbols into computer recognition data including font symbols, 
editing symbols, special characters, and lexigrams. The on-line recognition processor 
430 can be integrated in the control section 450 or it can be separate. 

15 The control section 450 recognizes a series of locating signals and stores them in 

the memory 440. At the same time, the control section 450 provides the on-line 
recognition processor 430 with a plurality of corresponding display signals to the display 
screen 410. As a next step, the on-line recognition processor 430 recognizes symbols 
written by the user and translates them into computer text, including font symbols. 

20 Alternatively, the on-line recognition processor 430 recognizes editing symbols and 
translates them into corresponding computer commands. 

When the on-line recognition processor 430 recognizes written symbols and 
translates them into computer-processible recognition data, such as font symbols, editing 

25 symbols, special characters or lexigrams, the control section 450 allows the user to check 
the recognized codes and correct any error in the codes. For example, the control section 
450 can list and display the written symbols and the recognized codes from the on-line 
recognition processor 430 on the display screen. If the user decides that the recognized 
codes are incorrect, the control section 450 can provide a separate window on the display 

30 screen for another input by the user. 
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The control section 450 stores text in an edited state, i.e., text generated by the 
editing apparatus, in the memory 440 according to the data provided by the on-line 
recognition processor 430. Alternatively, the control section 450 may store in the 
memory 440 just the editing information which was translated into computer-processible 
5 recognition data, such as font symbols or computer commands, depending on the written 
symbols (including editing symbols). If a command is executed by the user to 
incorporate any change into original text, the control section 450 will apply editing 
information selected by the user to the original text in order to provide edited text. If 
changes were made to the original text several times, the control section 450 will store, in 

10 memory 440, editing information corresponding to each change. The memory 440 can 
store text edited after recognition of written symbols (including editing symbols), i.e., 
text generated by the editing apparatus, under the control of the control section 450. Also, 
the memory 440 can store translated computer-processible recognition data, such as 
editing symbols or font symbols, under the control of the control section 450. Editing 

1 5 information is stored to correspond to a transparent layer. 

FIG. 4 is a flow chart showing the processing of a layer editing mode according 
to the second embodiment of the present invention. In FIG. 4, processing according to the 
second embodiment is similar to the processing illustrated in FIG. 2, except for step 522. 

20 At step 510, the control section 450 displays original text on the display screen 410. At 
step 512, the control section 450 determines whether the user demands a layer editing 
mode to edit the original text. In layer editing mode, the control section 450 controls the 
layer generating section 420 to generate and display a transparent layer at step 514. At 
step 516, the control section 450 detects whether the user initiates a pen input on a 

25 transparent layer. At step 518, the control section 450 recognizes a stream of locating 
signals and stores these signals in the memory 440. Also, the control section 450 
provides a plurality of corresponding display signals to the display screen 410 so that a 
pen trail can be displayed on the layer. 

30 At step 520, the control section 450 determines whether a pen input was 

completed. If a pen input is not made after a predetermined period of time, the control 
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section 450 will decide that the input has been completed. At step 522, the control 
section 450 controls the on-line recognition processor 430 to translate written symbols 
(including editing symbols) entered by the user into computer-processible recognition 
data, such as font symbols or computer commands. At step 524, the control section 450 
5 stores trail information generated by a pen input in the memory 440, together with 
corresponding positional information on the display screen. Alternatively, the control 
section 450 may only store computer-processible recognition data. If a command is 
executed by the user to incorporate any change into original text, the control section 450 
will apply editing information selected by the user to the original text in order to provide 
10 edited text. The control section 450 can store text in an edited form, i.e., text generated 
by the editing apparatus, in the memory 440. 

At step 526, the control section 450 determines whether the user has requested 
that a layer be stored. If a layer storage is commanded, the control section 450 will 
1 5 assign a layer identifier to the corresponding layer and will store the layer in the memory 
440. 

FIG. 5 is a flow chart showing the processing of a layer editing command 
according to the first embodiment of the present invention. FIGs. 6a and 6b show a layer 
20 editing picture according to the embodiments of the present invention. 

The editing apparatus of the present invention senses an input with a pen by the 
user on a transparent layer, displays the trail of the input on the transparent layer, and 
stores the trail information and corresponding positional information on the transparent 
25 input screen as single layer data. The editing apparatus processes original text according 
to an editing command based on layer information stored by the user. The processing of 
a layer editing command according to the present invention will be explained in detail. 

Referring to FIGs. 1 through FIG. 6, at step 310, the control section 150, 450 of 
30 the editing apparatus displays original text on the display screen 110, 410 according to 
the user's command. At step 320, the control section 150, 450 displays commands so 
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that the user can select an editing mode for executing a layer function. In other words, 
when original text is displayed on the display screen 110, 410, the control section 150, 
450 displays commands, which can be selected and executed by the user. If a particular 
command is inputted by the user, the control section 150, 450 will receive and determine 
5 the inputted command at step 320. If a "recognition" command is inputted, the control 
section 150, 450 will proceed with step 331. If a "display" command is inputted, the 
control section 150, 450 will proceed with step 341. If a "combine" command is inputted, 
the control section 150, 450 will proceed with step 351. 

10 If a "recognition" command is selected and inputted by the user, the control 

section 150, 450 will search layer identifiers and will display the corresponding layers, 
which were selected by the user at step 331. As described above, the user can select 
changes made to the original text by layer and display them over the original text. At 
step 333, the control section 150, 450 controls the recognition processor 140, 430 to 

15 analyze images of layer information stored in the memory 130, 440. Accordingly, the 
recognition processor 140, 430 analyzes written trail information, stored by layer, and 
translates symbols written by the user (including editing symbols) into computer- 
processible recognition data, such as font symbols or computer commands. At step 335, 
the control section 150, 450 stores computer-processible recognition data supplied from 

20 the recognition processor 140, 430. 

In addition, the control section 150, 450 enables the user to correct any error in 
the computer-processible recognition codes received from the recognition processor 140, 
430. For example, the control section 150, 450 can display a list of written symbols and 
25 the recognized codes from the recognition processor 140, 430 on the display screen. If 
the user decides that the recognized codes are incorrect, the control section 150, 450 can 
provide a separate window on the display screen for another input by the user. 

If a "display" command is selected and inputted by the user, the control section 
30 150, 450 will search layer identifiers and will display corresponding layers to be selected 
by the user at step 341. If a particular layer is selected by the user, the control section 
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150, 450 will question at step 343 whether the selected layer is to be displayed over the 
original text, or whether layer recognition data is to be displayed. 

FIGs. 6a and 6b show a layer editing picture according to the present invention. 
5 If the original text 100 is displayed on the display screen, the control section 150, 450 
will allow the user to select, by layer, any of the changes made to the original text. FIG. 
6a shows three layers 10, 20, 30 that are displayed over the original text. The memory 
130, 440 stores each layer exactly as was written by the user with a stylus on the layer. 
As shown in FIG 6b, if layer #1 (10) is selected by the user, the control section 150, 450 
10 will display any changes to the original text 100 which were made by writing on layer #1, 
displaying them over the original text 100 at step 347. The control section 150, 450 may 
only store computer recognition data for each layer at step 345. 

If a "combine" command is selected and inputted by the user, the control section 
15 150, 450 will search layer identifiers and will display corresponding layers to be selected 
by the user at step 351. If a particular layer is selected by the user, the control section 
150, 450 will provide text edited by the user according to layer recognition data. The 
control section 150, 450 can edit the original text according to layer recognition data, for 
example, computer-processible data such as font symbols, editing symbols, special 
20 characters, or lexigrams. As shown in FIG. 6b, the control section 150, 450 edits the 
original text by inserting computer text corresponding to a handwritten symbol at a 
position where an insert editing symbol is written and deleting text corresponding to a 
delete symbol in accordance with the recognition data corresponding to the editing 
symbols and handwritten symbols representing "insertion" and "deletion." 

25 

As described above, since the control section 150, 450 stores trail information 
written by the user and corresponding positional information on the transparent input 
screen as single layer data, it can edit the original text based on the corresponding 
positional information. That is, the trail information written by the user on a transparent 
30 layer is stored together with corresponding positional information from the original text. 
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The positional information includes trail information stored as an image and the position 
of the trail on the transparent layer, i.e., the starting coordinate of the trail. 

FIG. 7 shows the structure of a memory for storing layers according to the 
5 embodiments of the present invention. The memory 700 stores any changes to an original 
text having been made on a transparent layer exactly as was written by the user with a 
stylus on the transparent layer. Trail information 740 written by the user on a transparent 
layer is stored together with corresponding positional information 730 from the original 
text. The positional information 730 includes trail information stored as an image and the 

10 position of the trail on the transparent layer, i.e., the starting coordinate of the trail. The 
memory 700 assigns an index 720 to an editing symbol written by the user, and stores 
changes made to the original text according to their indexes. The editing apparatus then 
assigns a footnote number to each editing symbol at a corresponding position on the 
original text, and displays the change corresponding to each footnote number on the 

1 5 original text. 

If changes were made to the original text many times, corresponding transparent 
layers with respective layer identifiers can be stored separately. A symbol written by the 
user, when recognized, is translated into computer-processible recognition data, such as 
20 an editing symbol 750 or a font symbol 760, so that only editing information can be 
stored. The editing information can be stored to correspond to a transparent layer. If 
changes were made to the original text several times, the memory 700 will store 
information about the time when each change was made. 

25 According to the present invention, changes entered by writing directly on a 

screen displaying original text are displayed over the original text according to the trails 
of the handwritten entry. The user can edit original text displayed on the display screen 
in a similar manner to the manual editing of paper printing. In addition, according to the 
present invention, written symbols can be combined with original text or stored 

30 separately as footnotes, according to the results of recognizing the written symbols. 
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While the invention has been shown and described with reference to certain 
preferred embodiments thereof, it will be understood by those skilled in the art that 
various changes in form and details may be made therein without departing from the 
spirit and scope of the invention as defined by the appended claims. 
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